Course Management System’s 
Compatibility with Teaching Style 
Influences Willingness to Complete Training 


Audrey Smith Pereira, Ph.D. 

Fitchburg State University, Fitchburg, Massachusetts 

Monika Maya Wahi 

Laboure College, Milton, Massachusetts 
Vasanta Health Science LLC, Cambridge, Massachusetts 


Abstract 

Although course management systems (CMSs) provide technology platfonns that help faculty 
members adopt better techniques for teaching and learning, and training contributes to faculty 
infonnation technology (IT) use, many higher education faculty members do not complete CMS 
training programs, resulting in underuse of CMSs. Therefore, the overall purpose of this research 
was to address how instructor perceptions influence willingness to complete IT training on 
CMSs, and to discern techniques university administrators can implement to improve training 
completion rates and, ultimately, CMS adoption rates. The basic design of the study was a cross- 
sectional survey. Data were obtained from 102 public university faculty members who responded 
to an anonymous, web-based survey about their perceptions of the relative advantage, 
compatibility, complexity, trialability, and observability of their institution’s CMS. The data 
were analyzed using multiple linear regression models. Compatibility, defined as the degree to 
which instructors perceive the CMS as being consistent with their existing values, past 
experiences, and current or future teaching needs, was statistically significantly associated with 
willingness to complete online and in-person CMS training after controlling for other factors. 
Major findings suggest that faculty training on the CMS is not “one size fits all.” If greater use 
of CMSs by faculty is to be achieved, university administrators should consider compatibility of 
teaching style with CMS adoption when developing and promoting CMS training. 

Keywords : higher education faculty members, course management system, technology adoption, 
educational technology, faculty training and development, diffusion of innovation theory 
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Introduction 


Many higher education administrators offer course management systems (CMSs) to their 
faculty members to use in their courses (Green, 2010), and these CMSs help instructors improve 
teaching and learning (Tsai & Talley, 2013; Yidana, Sarfo, Edwards, Boison, & Wilson, 2013). 
However, CMS adoption rates by faculty are low (Green, 2010; Unwin et ah, 2010). The lack of 
faculty training on infonnation technology (IT) is one factor that contributes to low faculty IT 
adoption rates (deNoyelles, Cobb, & Lowe, 2012; Goktas, Yildirim, & Yildirim, 2009; Masalela, 
2009; Smolin & Lawless, 2011). Yet, researchers have found that many faculty members are 
unwilling to complete IT training (Hassan, 2011; Hurtado, Eagan, Pryor, Pereira, 2015; Whang, 
& Tran, 2012). Faculty members who do not complete IT training on the CMS will be less likely 
to adopt the CMS, resulting in lost opportunities to increase the quality of teaching and learning 
at their institutions. 

Therefore, this study examined faculty members’ perceptions of their organization’s 
CMS that may influence their willingness to complete IT training on the CMS. The research was 
grounded in components of Rogers’ (2003) diffusion of innovations (DOI) theory. According to 
Rogers (2003), five perceived attributes of an innovation partially explain technology adoption: 
relative advantage, compatibility, complexity, trialability, and observability. Rogers asserted that 
perceived relative advantage, compatibility, trialability, and observability of an innovation 
relates positively to its adoption rate, whereas an innovation’s perceived complexity has a 
negative influence on its adoption. 

Research has shown that the quality of teaching and learning increases if faculty 
members more broadly adopt their organization’s CMS (Tsai & Talley, 2013; Yidana et ah, 
2013). Research has also shown that faculty training on their CMS improves faculty adoption of 
these systems (deNoyelles et ah, 2012; Hixon, Buckenmeyer, Barczyk, Feldman, & Zamojski, 
2012; McBride & Thompson, 2011), but unfortunately, the rate of faculty training on CMSs is 
low (Hassan, 2011; Hurtado et al., 2012; Pereira, 2015). Therefore, increasing faculty 
willingness to complete CMS training on their organization’s CMS, the topic of this research, 
should ultimately lead to higher CMS adoption rates by faculty members, and consequently, 
improved quality of teaching and learning in higher education. 

This paper will first provide a review of the literature associated with faculty adoption 
and willingness to complete training on educational technology, including CMSs. Next, the 
research questions and methodology for the study will be described. Results will then be 
presented, followed by a discussion, which will include recommendations for administrative 
approaches to improving CMS training completion rates among faculty members, as well as 
recommendations for future research. 

Review of Related Literature 

The literature indicates that the use of IT positively contributes to teaching and learning 
in the higher education classroom (Archambault, Wetzel, Foulger, & Williams, 2010; Newhouse, 
Buckley, Grant, & Idzik, 2013). Consequently, CMSs, including Blackboard, have been 
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developed to improve the teaching and learning process; to facilitate this goal, they also offer 
online course management tools (Blackboard, Inc., 2017). This suggests that use of CMSs, such 
as Blackboard, in the higher education classroom has a considerable potential to increase the 
quality of teaching and learning. This contention is supported by research conducted by Yidana 
et al. (2013) who found that learning was improved through the provision of a CMS that 
permitted students to control their learning process and learn independently, as well as research 
conducted by Tsai and Talley (2013) who reported that foreign language students’ reading 
comprehension improved when they used a CMS. Also, Unal and Unal (2011) described a study 
in which students rated different teaching and learning functions within two CMSs (Blackboard 
and Moodle) but that, regardless of the CMS, the students rated these teaching and learning 
functions highly, indicating that students were ready to adopt CMSs. Additionally, from their 
research on course design and delivery elements that affect student satisfaction, Simon, Jackson, 
and Maxwell (2013) suggested that CMSs are valuable scholastic tools, in that they can represent 
“a rigorous alternative or supplement to traditional instruction” (p. 112). However, they also 
concluded that professors should not be replaced by CMSs in the learning process. 

Although researchers have found that IT has the potential to improve the quality of 
teaching and learning in higher education (Archambault et al., 2010; Newhouse et al., 2013), and 
CMSs are now commonly present in higher education (Green, 2010) many faculty members are 
slow to integrate IT (and CMSs) into their classrooms (Abrahams, 2010; Bothnia & Cant, 2011; 
Unwin et al., 2010; Yohon & Zimmerman, 2006) and resist using IT for teaching and learning 
(Hicks, 2011). Additionally, faculty members are more proficient in basic rather than high-level 
technologies (Allen & Seaman, 2012; Chitiyo & Hannon, 2009; Kinuthia, 2005; Rocca, 2010), 
and Allen and Seaman (2012) as well as Ertmer and Ottenbreit-Lefwich (2010) suggested that 
faculty are more likely to use IT to facilitate traditional rather than new instructional techniques. 
Also, although the literature suggests that faculty IT training is one factor that influences 
adoption of IT in the classroom (deNoyelles et al., 2012; Goktas et al., 2009; Kidd, 2010; 
Masalela, 2009; McBride & Thompson, 2011; Porter, 2011; Potter & Rockinson-Szapkiw, 2012; 
Samarawickrema & Stacey, 2007; Smolin & Lawless, 2011), it also suggests that many faculty 
members are unwilling to complete fonnal IT training (Hassan, 2011; Hurtado et al., 2012; 
Pereira, 2015; Yohon & Zimmerman, 2006). 

Because of the low faculty adoption rates (Green, 2010; Unwin et al., 2010) and costs 
associated with implementing a CMS at higher education organizations, many researchers have 
focused on studying barriers to CMS adoption, as well as studying factors that may improve 
faculty adoption rates (Bennett & Bennett, 2003; Green, 2010; Keesee & Shepard, 2011; 
Mallinson & Krull, 2013; Samarawickrema & Stacey, 2007; West, Waddoups, & Graham, 
2007). For example, Bennett and Bennett (2003) studied 20 higher education faculty members 
and concluded that workshop-based training improves faculty attitudes toward the CMS, and 
West et al. (2007) asserted that this indicates that faculty training increases the probability of 
CMS adoption. 

Based on this body of research related to barriers to IT adoption in general and CMS 
adoption specifically, and factors that may influence adoption, some writers have recommended 
improvements to faculty IT training, as a way to improve instructional IT adoption. This is 
because offering higher-quality training may result in increased faculty willingness to complete 


Online Learning - Volume 21 Issue 1 - March 2017 


38 



the training. These recommendations include the following: offering pedagogical as well as 
technological training (Calderon et al, 2012; Iorio, Kee, & Decker, 2012; Kidd, 2010; Mark, 
Thadani, Santandreu Calonge, Pun, & Chiu, 2011; Samarawickrema & Stacey, 2007); 
developing research-based technology training programs (Onyia & Onyia, 2011); ensuring IT 
training is relevant to faculty needs (Kidd, 2010) and is accessible (Keengwe, Kidd, & Kyei- 
Blankson, 2009); requiring training as part of employment obligations (Onyia & Onyia, 2011); 
aligning IT training with institutional policies and procedures (Korr, Derwin, Greene, & 
Sokoloff, 2012); and offering in-person as well as online training (Kidd, 2010). 

Scholars have also researched the influence of CMS training specifically (Allen & 
Seaman, 2012; Bennett & Bennett, 2003; Samarawickrema & Stacey, 2007). Samarawickrema 
and Stacey (2007) asserted that CMS training is more valuable to faculty members if it is 
applicable, appropriate, timely, and relevant. Further, Allen and Seaman (2012) found that while 
administrators rated their CMS training offerings as high quality, faculty attitudes about the CMS 
training were less positive. 

However, fewer studies focused on the factors that influence instructors’ willingness to 
attend, and presumably complete, IT training (on the institution’s CMS or otherwise). This body 
of literature indicates that the following factors influence faculty willingness to attend or 
complete training: professional growth (Kinuthia, 2005); time away from duties (Kinuthia, 2005; 
Sandford, Dainty, Belcher, & Frisbee, 2011); free hardware/software (Kinuthia, 2005); timing of 
training programs (Roman, Kelsey, & Lin, 2010; Sandford et al., 2011), skill level (Chen et al., 
2000); travel distance (Sandford et al., 2011); teaching experience (Sandford et al., 2011); and 
specific pedagogical competencies (Carril, Samnamed, & Selles, 2013). These studies also 
indicated that incentives, including monetary rewards, release time, and positive impacts on 
tenure and promotion encourage faculty to attend IT training (Kinuthia, 2005; Sandford et al., 
2011). These results should be considered alongside studies that found that incentives are an 
important factor in improving faculty IT adoption rates (Allen & Seaman, 2012; Al-Senaidi, Lin, 
& Poirot, 2009; Aremu, Fakolujo, & Oluleye, 2013; Keengwe et al., 2009; Masalela, 2009; 
McKissic, 2012; Yidana et al., 2013). 

The current state of the literature on this subject suggests that research on factors that 
improve higher education faculty’s willingness to complete CMS training, both online and in- 
person, are lacking. Thus, this study aims to fill this important gap in the literature. Although 
higher education administrators invest considerable portions of their institutions’ budgets in 
providing high-quality CMS services (Green, 2010) and CMS training (Meyer, 2014; Pereira, 
2015), unfortunately, many faculty members are unwilling to complete the CMS training offered 
(Hassan, 2011; Hurtado et al., 2012; Pereira, 2015). This contributes to low faculty CMS 
adoption rates, resulting in lower quality teaching and learning than would be possible with CMS 
adoption, and lost opportunities to improve student learning experiences in higher education. 

This study explored how higher education faculty perceptions of the relative advantage, 
compatibility, complexity, trialability, and observability (as defined by Rogers’ (2003) DOI 
theory) of their institution’s CMS influence their willingness to complete online and in-person IT 
training on use of the CMS. Specific research questions were the following: (a) What is the 
relative contribution of faculty perceptions of the relative advantage of using their institution’s 
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CMS in teaching and learning to their willingness to complete online and in-person IT training 
on the CMS? (b) What is the relative contribution of faculty perceptions of the compatibility of 
using their institution’s CMS to their willingness to complete online and in-person IT training on 
the CMS? (c) What is the relative contribution of faculty perceptions of the complexity of the 
CMS to their willingness to online and in-person IT training on the CMS? (d) What is the 
relative contribution of faculty perceptions of the trialability of their CMS to their willingness to 
complete online and in-person IT training on the CMS? (e) and What is the relative contribution 
of faculty perceptions of the observability of their CMS to their willingness to complete online 
and in-person IT training on the CMS? 


Methods 


Study Population/Sampling 

All 392 full-time and part-time faculty members who taught undergraduate and graduate 
courses at Fitchburg State University (FSU) in Fitchburg, Massachusetts, a public university in 
the northeast United States, were invited to participate in an anonymous, web-based survey in 
late 2014. The survey included questions about their demographics, perceptions of their 
institution’s CMS, and willingness to complete CMS training. The response rate was 29%.After 
exclusions for ineligible responses, 102 surveys were used for data analysis, yielding a revised 
response rate of 26%. 

Forty-seven percent of the respondents were male and 46% female, while eight 
respondents did not identify their gender. At FSU, the following ranks are available: instructor, 
assistant professor, associate professor, and full professor (called “professor”). The instructor 
level can be occupied by full-time faculty, but is typically the level assigned to adjunct and part- 
time faculty. In the sample, 26% were instructors, 24% assistant professors, 23% associate 
professors, and 27% professors. Respondents taught in the following departments: 34% Science, 
Technology, Engineering, and Mathematics; 16% Social Science, Economics, History, and 
Political Science; 15% Education, Communication, and Game Design; and 36% taught in other 
departments, including Business Administration, English Studies, Industrial Technology, 
Interdisciplinary Studies, and Nursing. 

Data Collection 

After obtaining approval from the appropriate Institutional Review Boards for the 
Protection of Human Subjects in Research (IRB), data were collected anonymously using a 
public link through SurveyMonkey (SurveyMonkey, 2015). The survey questions that measured 
perceptions of the CMS were considered independent variables in this study, and were based on 
subscales developed by Keesee (2010). Keesee (2010) named her instrument the CMS Diffusion 
of Innovations Survey (CMS-DOIS). Perceptions of the relative advantage, compatibility, 
complexity, trialability, and observability were measured using statements asking respondents to 
rate them on a 5-point Likert scale where 1 = strongly disagree, 2 = disagree, 3 = 
undecided/neutral, 4 = agree, and 5 = strongly agree. To score each subscale, the mean of the 
Likert scale questions were taken (for number of questions per subscale, see Table 1). The 
survey questions that measured willingness to complete in-person and online CMS training were 
considered dependent variables, and were developed specifically for this study (Pereira, 2015). 
These were measured with two statements (one for online training and one for in-person training) 
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using a 5-point Likert scale, where 1= not at all willing, 2 = somewhat unwilling, 3 = neither 
willing nor unwilling, 4 = somewhat willing, and 5 = very willing (see Table 1). 

Table 1 

Survey Question Origins, Subscale Definitions, Number of Items, Cronbach's Alpha, and Sample Questions 


Instrument 
Name or 
Source 

Subscale 

Name 

Sub scale 

Definition* 

Number 
of Items 

Cronbach's 

Alpha 

Example Survey 

Question 

CMS- 

DOIS 

Relative 

advantage 

The degree to which 
faculty members perceive 
that incorporating the use 
of their institution's CMS 
in teaching and learning 
is better than their current 
method. 

15 

0.939 

Based on my 
experiences with the 
Blackboard CMS, I 
think using the 

Blackboard CMS 
enables (would enable) 
me to significantly 
improve the overall 
quality of my teaching. 

CMS- 

DOIS 

Compatibility 

The degree to which 
faculty members perceive 
the CMS as being 
consistent with their 
existing values, past 
experiences, and current 
or future teaching needs. 

10 

0.821 

Based on my 
experiences with the 
Blackboard CMS, I 
think using the 

Blackboard CMS fits 
(would fit) well with my 
teaching style. 

CMS- 

DOIS 

Complexity 

The degree to which 
faculty members perceive 
the CMS as relatively 
difficult to understand 
and use. 

10 

0.916 

Based on my 
experiences with the 
Blackboard CMS, I 
think learning to use the 
Blackboard CMS is 
(would be) easy for me. 

CMS- 

DOIS 

Trialability 

The degree to which 
faculty members perceive 
that they may experiment 
with the CMS before they 
decide to incorporate it 
into their instruction. 

7 

0.767 

Based on what I know 
right now, I think I was 
(am) pennitted to use 
the Blackboard CMS on 
a trial basis long enough 
to see what it could/can 
do. 

Based on what I know 
right now, I think I have 
observed how other 
teachers are using the 
Blackboard CMS in 
their teaching. 

CMS- 

DOIS 

Observability 

The degree to which 
faculty members perceive 
the results of use of the 
CMS to be visible to 
others. 

6 

0.762 

Pereira 

2015 

Willingness to 

complete 

online 

Blackboard 

training 

At time of survey, over 
the next 12-month period, 
how willing faculty 
members were to 
complete any Blackboard 
CMS online training 
offered by FSU. 

1 

NA 

Over the next 12-month 
period, how willing are 
you to complete any 
Blackboard CMS online 
training module(s) 
offered by FSU? 

Pereira 

2015 

Willingness to 
complete in- 
person 
Blackboard 
training 

At time of survey, over 
the next 12-month period, 
how willing faculty 
members were to 
complete any Blackboard 
CMS in-person training 
offered by FSU. 

1 

NA 

Over the next 12-month 
period, how willing are 
you to complete any 
Blackboard CMS face- 
to-face training offered 
by FSU? 


Note: * Based on Rogers’ (2003) classifications of the five perceived attributes of an innovation. 
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Demographic information was also collected, as this infonnation has been shown to have 
the potential to mediate the relationship between the dependent variables and independent 
variables (Allen & Seaman, 2012; Al-Senaidi et ah, 2009; Ertmer & Ottenbreit-Leftwich, 2010, 
Hurtado et al, 2012; Keengwe et ah, 2009; Keesee, 2010; Onyia & Onyia, 2011; Yidana et ah, 
2013). These mediating variables were gender, age, department, tenure status, rank, length of 
CMS use, and level of CMS expertise (see Table 2 for mediating variable definitions). 

Table 2 

Mediating Variable Definitions 


Mediating Var 

Measurement 

Levels 

Definition 

Gender 

Categories 

Male 

Female 

Other/refused 

Gender at time of 
survey 

Age 

Categories 

20-29 

30-39 

40-49 

50-59 

60-69 

70-79 

80+ 

Age at time of survey 

Department 

Categories 

Science, Technology, 
Engineering, and Math 

Social Science 

Education 

Economics, History, and 
Political Science 

C ommunications, 

Game Design 

All other departments 

Primary department 
where faculty worked 
at time of survey 

Tenure Status 

Categories 

Full-time tenured 

Full-time tenure-track 
Full-time nontenure- 
track 

Part-time 

Faculty tenure status at 
time of survey 

Rank 

Categories 

Instructor 

Assistant Professor 
Associate Professor 
Professor 

Other (please specify) 

Faculty rank at time of 
survey 

Length of CMS 
use 

Years 

0-30 

(0 for less than 1 year 

Or if faculty did not use 
the CMS) 

Number of years 
faculty had used the 
CMS at time of survey 


Descriptive Analysis Classification 
Same as levels 


Collapsed into the following 
groups due to low sample size: 

20-39 

40-49 

50-59 

60-69 

70+ 

Collapsed into the following 
groups due to low sample size: 

Science Technology, Engineering, 
and Math 

Social Science, Economics, 
History, and Political Science 
Education, Communication, and 
Game Design 
Other 

Collapsed into the following 
groups due to low sample size: 

Full-time tenured 
Full-time tenure-track 
Full-time and part-time nontenure- 
track 

Collapsed into the following 
groups after analyzing "other" 
responses: 

Instructor 
Assistant Professor 
Associate Professor 
Professor 

Same as levels 
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Mediating Var 

Measurement 

Levels 

Definition 

Descriptive Analysis Classification 

Level of CMS 
expertise 

Likert Scale 

1 =none 

2 = little 

3 = adequate 

4 = more than adequate 

5 = expert 

Faculty level of 
expertise using CMS 
at time of survey 

Same as levels 

The 

survey was 

administered during 

a two-week period 

in October 2014. To ensure 


anonymity, the survey was accessed via a publicly available, universal link provided in e-mail to 
each faculty member. One week prior to survey administration, the university’s chief information 
officer sent the faculty list an e-mail with details about the study. In addition, a reminder e-mail 
with the survey link was sent one week prior to the survey close date. 

Data Analysis 

After downloading the data from SurveyMonkey, subscales for the CMS-DOIS 
instrument were scored using SPSS (SPSS, n.d.). The subscales were found to be internally 
consistent through a Cronbach’s alpha analysis (see Table 2). The values ranged from .762 to 
.939, which are considered reliable. The questions used to measure willingness to complete in- 
person and online training were found to have convergent validity with actual training 
participation (Pereira, 2015). Specifically, answers to questions on intention to complete online 
and in-person CMS training in the next 12 months were correlated with self-reports of training 
completion in the previous 12 months. The data indicated a trend that the more willing a person 
was to complete training, the more likely they were to have completed at least one training 
session over the previous 12 months. 

Descriptive statistics were analyzed for the sample overall and separately for willingness 
to complete online versus in-person training. Means and distributions of continuous variables 
were considered, as were correlations. 

To address the research questions, two separate analyses of variance (ANOVA) and 
linear regression models were developed, one to assess the association of the independent 
variables with the dependent variable “willingness to complete online training,” and the other to 
assess the association of the independent variables with the dependent variable “willingness to 
complete in-person training.” Mediating variables were entered as independent variables in the 
model to control for their potential influence on the dependent variable. 

A best-subsets modeling procedure was followed (Hosmer, Borko, & Lemeshow, 1989; 
King, 2003). The best-subsets modeling approach is a method of selecting optimal predictor 
variables for a dependent variable, typically a binary one (Hosmer et al., 1989), but the 
procedure can be used in linear regression with a continuous dependent variable (King, 2003). 
The purpose of applying the best-subsets approach in this study was to use a data-driven rather 
than intuitive method of selecting an optimal set of predictor variables for the final model. 

Results 

Table 3 provides descriptive statistics for the faculty sample of n=102 with respect to 
categorical, demographic characteristics. 
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Table 3 

Descriptive Statistics for Categorical Variables 


Category 

Levels 

n (%) 

Online Willingness 
(M, SD) 

In-person Willingness 
(M, SD) 

All 

All 

102,(100%) 

3.52,(1.31) 

3.46,(1.32) 

Gender 

Male 

48, (47%) 

3.27,(1.35) 

3.42,(1.18) 


Female 

46, (45%) 

3.80,(1.22) 

3.50,(1.46) 


Other 

8, (8%) 

3.38,(1.41) 

3.50,(1.41) 

Age Group 

20-39 years 

19,(19%) 

3.58,(1.22) 

3.16,(1.34) 


40-49 years 

22, (22%) 

3.41,(1.33) 

3.41,(1.40) 


50-59 years 

25, (25%) 

3.64,(1.25) 

3.52,(1.29) 


60 + years 

21,(21%) 

3.62,(1.40) 

3.86, (1.2) 


Refused 

15,(15%) 

3.27,(1.49) 

3.27,(1.39) 

Tenure Status 

Full-time Tenured 

46, (45%) 

3.22,(1.33) 

3.39,(1.31) 


Full-time Tenure-track 
Full time and Part-time 

24, (24%) 

3.46,(1.32) 

3.42,(1.38) 


Nontenure-track 

32, (31%) 

4.00,(1.16) 

3.59,(1.32) 

Rank 

Instructor 

27, (26%) 

4.26, (0.94) 

3.78,(1.37) 


Assistant Professor 

24, (24%) 

3.63,(1.35) 

3.42,(1.38) 


Associate Professor 

23, (23%) 

3.00,(1.31) 

3.13,(1.29) 


Professor 

28, (27%) 

3.14, (1.3) 

3.46,(1.23) 

Department 

STEM 

35, (34%) 

3.31,(1.37) 

3.40,(1.29) 


SEHP 

16,(16%) 

3.5, (0.97) 

3.81,(1.05) 


ECG 

15,(15%) 

4.00,(1.31) 

3.47,(1.41) 


Other 

36, (35%) 

3.53,(1.38) 

3.36,(1.44) 


Note: Online Willingness = willingness to complete online CMS training, In-person Willingness = willingness to complete in-person CMS 
training. STEM = Science, Technolgy, Engineering, and Mathmatics. SEHP = Social Science, Economics, History, and Political Science. ECG 
= Education, Communication, and Game Design. Other includes Business Administration, English Studies, Industrial Technology, 
Interdisciplinary Studies, and Nursing. 


As indicated in Table 3, mean willingness to complete training fell mostly between 3 and 
4, which is a small range. Females had a higher mean willingness to complete both online (3.80 
vs. 3.27) and in-person training (3.50 vs. 3.42) than males. In most cases, older age levels were 
more willing to complete training, with the exception of the 40-49 level who were less likely to 
complete online training than the other levels (20-39 years = 3.58, 40-49 years = 3.41, 50-59 
years = 3.64, and 60+ years = 3.62). Additionally, faculty members at earlier stages or not on the 
tenure track were more willing to complete training, especially in-person training (full-time 
tenured = 3.39, full-time tenure-track = 3.42, full-time and part-time non-tenure-track = 3.59). 
Likewise, in general, lower ranks expressed higher mean levels of willingness to complete 
training, excluding professors who were more willing to complete training than associate 
professors (online willingness: instructor = 4.26, assistant professor = 3.63, associate professor = 
3.00, professor = 3.14; in-person willingness: instructor = 3.78, assistant professor = 3.42, 
associate professor = 3.13, professor = 3.46). Finally, members of the Education, 
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Communication, and Game Design departments were much more willing to complete online 
training while members of the Social Science, Economics, History, and Political Science 
departments were much more willing to complete in-person training than the other departments 
(online willingness: Science, Technology, Math, and Science = 3.31, Social Science, Economics, 
History, and Political Science = 3.5, Education, Communications, and Game Design = 4.00, 
Other, including Business Administration, English Studies, Industrial Technology, 
Interdisciplinary Studies, and Nursing = 3.53; in-person willingness: Science, Technology, 
Mathematics, and Science = 3.40, Social Science, Economics, History, and Political Science = 
3.81, Education, Communications, and Game Design = 3.47, Other, including Business 
Administration, English Studies, Industrial Technology, Interdisciplinary Studies, and Nursing = 
3.36). 


Table 4 provides summary statistics for the continuous variables. 


Table 4 

Summary Statistics for Continuous Variables 


Variable 

M* 

SD 

Online Willingness 

3.52 

1.31 

In-person Willingness 

3.46 

1.32 

Relative Advantage 

3.58 

0.77 

Compatibility 

3.66 

0.73 

Complexity 

3.66 

0.78 

Trialability 

3.36 

0.70 

Observability 

3.48 

0.72 

Length use 

6.16 

4.22 

Level expertise 

3.26 

1.04 


Note: N=102. Online Willingness = willingness to complete online CMS training and In-person Willingness = 
willingness to complete in-person CMS training. *Length of use measured as discrete numerical variable ranging 
from 0 and 30 years, where 0 = less than 1 year or no use. Other variables measured on 5-point Likert scales. 

As indicated in Table 4, the mean for the continuous variables that measured faculty 
perceptions of the CMS (independent variables) fell in a small range, between 3.36 and 3.66. 
Most of the independent variables had low to moderate positive correlations with each other, 
apart from relative advantage and compatibility, which were highly correlated with each other 
(see Table 5). The dependent variables (online and in-person willingness) were highly correlated 
with each other. Additionally, the dependent variables had low positive correlations with length 
of use and expertise level, excepting the correlation between in-person willingness and expertise 
level which was negative. 
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Table 5 

Correlation Matrix 


Variable 

1 

2 

3 

4 

5 

6 

7 

8 

9 

1. Online will 

1.000 

.709* 

443 ** 

432 ** 

.241* 

.173 

.077 

.041 

.076 

2. In-person will 

.709** 

1.000 

099 ** 

290 ** 

.035 

.088 

.023 

.088 

-.058 

4. Relative adv 

.443** 

299 ** 

1.000 

.807** 

.564** 

.270** 

.373** 

.367** 

299 ** 

5. Compatibility 

.432** 

.290** 

.807** 

1.000 

.578** 

.233** 

.322** 

.370** 

.367** 

6 . Complexity 

.241* 

.035 

.564** 

.578** 

1.000 

.379** 

.373** 

.546** 

.593** 

7. Trialability 

.173 

.088 

.270** 

.233** 

.379** 

1.000 

.527** 

.169 

.217* 

8 . Observability 

.077 

.023 

.373** 

.322** 

.373** 

.527** 

1.000 

.378** 

400 ** 

9. Length 

.041 

.008 

.367** 

.370** 

.546** 

.169 

.378** 

1.000 

170** 

10. Expert 

.076 

-.058 

299 ** 

.367** 

.593** 

.217* 

.400** 

.170** 

1.000 


Note: N= 102. Online willingness = willingness to complete online CMS training. In-person willingness = 
willingness to complete in-person CMS training. *p < .05. **p < .01. 

Tables 6 and 7 present the ANOVA and linear regression results for the dependent 
variable “willingness to complete online training.” 

Table 6 

Analysis of Variance for Predictors of Willingness to Complete Online Training 



Sum of 
Squares 

df 

Mean Square 

F 

Sig. 

Regression 

53.534 

9 

5.948 

4.563 

.000 

Residual 

119.927 

92 

1.304 



Total 

173.461 

101 





Note: Dependent variable measurement: Willingness to complete online CMS training. 
Table 7 


Predictors of Willingness to Complete Online Training 


Predictor 

Beta (0) 

t statistic 

p-value 

VIF 

Independent variables 

Compatibility 

.490 

5.451 

.000 

1.075 

Mediating variables 

Department 

SEHP 

.117 

1.176 

.243 

1.319 

CGE 

.452 

3.794 

.000 

1.889 

Other 

.221 

2.079 

.040 

1.506 

Age 

20-39 years 

.066 

.617 

.539 

1.527 

40-49 years 

-.010 

-.087 

.931 

1.726 

60+ years 

-.033 

-.307 

.759 

1.580 

Refused 

-.105 

-.999 

.321 

1.461 


Online Learning - Volume 21 Issue 1 - March 2017 


46 



Interaction variables 

CGE x 40-49 years ..234 -2.104 .038 1.643 

Note: Dependent variable is willingness to complete online training. SEHP = Social Science, Economics, History, 
and Political Science. ECG = Education, Communication, and Game Design. Other includes Business 
Administration, English Studies, Industrial Technology, Interdisciplinary Studies, and Nursing. 

The ANOVA was statistically significant (F= 4.563 at 9 At,p = 0.000), so the model 
was interpreted. After modeling, only the perception of compatibility, defined as the degree to 
which faculty members perceive the CMS as consistent with their existing values, past 
experiences, and current or future teaching needs, was significantly positively associated with 
willingness to complete training online (standardized fi = 0.490, p = 0.000). 

Tables 8 and 9 present the ANOVA and linear regression results for the dependent 
variable “willingness to complete in-person training.” 

Table 8 

Analysis of Variance for Predictors of Willingness to Complete In-person Training 



Sum of 
Squares 

df 

Mean Square 

F 

Sig. 

Regression 

49.284 

15 

3.286 

2.242 

.010 

Residual 

126.059 

86 

1.466 



Total 

175.343 

101 





Note: Dependent variable measurement: Willingness to complete in-person person training. 

Table 9 


Predictors of Willingness to Complete In-person Training 


Predictor 

Beta (fi) 

t statistic 

p-value 

VIF 

Independent variables 
Compatibility 

Mediating variables 

.242 

2.469 

.016 

1.152 

Tenure Status 





Full-time Tenure-track 

.244 

1.263 

.210 

4.458 

Full-time and Part-time 
Nontenure-track 

.125 

.615 

.540 

4.937 

Rank 





Instructor 

.163 

.925 

.357 

3.714 

Assistant Professor 

.264 

1.363 

All 

4.497 

Associate Professor 

-.030 

-.251 

.802 

1.677 

Gender 





Female 

.367 

2.414 

.018 

2.763 

Other 

.089 

.702 

.484 

1.921 

Age 





20-39 years 

-.203 

-1.613 

.111 

1.905 
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40-49 years 

.117 

.910 

.366 

1.983 

60+ years 

.149 

1.269 

.208 

1.645 

Refused 

-.091 

-.653 

.516 

2.315 

interaction variables 

Female x Full-time Tenure-track 

-.425 

-2.732 

.008 

2.893 

Female x Full-time and Part- 
time Nontenure-Track 

-.425 

-2.455 

.016 

3.576 

Assistant Professor x 40-49 age 

-.384 

-2.912 

.005 

2.082 


Note: Dependent variable: Willingness to complete in-person training on the CMS. 


For the in-person final model, the ANOVA was statistically significant (F = 2.242 at 15 
df., p = 0.010), so the model was interpreted. This model demonstrates that of the independent 
variables, only compatibility was significantly positively associated with willingness to complete 
training in-person (standardized fi = 0.242. p = 0.016). 

For this study, compatibility was defined as the degree to which faculty members 
perceive the CMS as consistent with their existing values, past experiences, and current or future 
teaching needs. Because in multivariate analysis, compatibility was the only independent 
variable statistically significantly associated with willingness to complete training on the CMS, 
both online and in-person, a bivariate analysis of the mean compatibility score for each 
mediating variable category was conducted. Table 10 provides a summary of this analysis. 

Table 10 

Descriptive Analysis of Compatibility Scores 


Compatibility Score 


Category 

Levels 

n (%) 

(M, SD) 

All 

All 

102,(100%) 

3.66 (.73) 

Gender 

Male 

48, (47%) 

3.71, (.66) 


Female 

46, (45%) 

3.67, (.75) 


Other 

8, (8%) 

3.38,(1.41) 

Age Group 

20-39 years 

19,(19%) 

3.68, (.72) 


40-49 years 

22, (22%) 

3.80, (.62) 


50-59 years 

25, (25%) 

3.74, (.70) 


60 + years 

21,(21%) 

3.56, (.78) 


Refused 

15, (15%) 

3.43, (.87) 

Tenure Status 

Full-time Tenured 

46, (45%) 

3.54, (.81) 


Full-time Tenure-track 

24, (24%) 

3.65, (.60) 


Full time and Part-time 
Non-tenure-track 

32, (31%) 

3.84, (.67) 

Rank 

Instructor 

27, (26%) 

3.95, (.65) 


Assistant Professor 

24, (24%) 

3.68, (.58) 


Associate Professor 

23, (23%) 

3.59, (.68) 
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Professor 

Department STEM 

SEHP 
ECG 
Other 


28,(27%) 3.42, (.87) 

35, (34%) 3.87, (.42) 

16,(16%) 3.68, (.76) 

15,(15%) 3.41, (.67) 

36, (35%) 3.56, (.73) 


Note: STEM = Science, Technolgy, Engineering, and Mathmatics. SEHP = Social Science, Economics, History, and Political Science. ECG = 
Education, Communication, and Game Design. Other includes Business Administration, English Studies, Industrial Technology, Interdisciplinary 
Studies, and Nursing. 


As shown in Table 10, most mediating variable levels were not considerably different 
with respect to mean compatibility scores. However, for tenure status there was a trend toward 
lower compatibility scores associated with higher tenure status (full-time tenured = 3.54, full¬ 
time tenure-track = 3.65, full-time and part-time non-tenure-track = 3.84). Similarly, for rank, 
mean compatibility scores decreased as ranks increased (instructor = 3.95, assistant professor = 
3.68, associate professor = 3.59, professor = 3.42). 

Table 9 also indicates that the mean compatibility score for males was slightly higher 
than for females (3.71 vs. 3.67), and the respondents who did not report their gender scored 
much lower than the two other groups (3.38). Generally, as age increased, mean compatibility 
scores decreased. Excepting those in the 20-39 year old range who scored less than the 40-49 
and 50-59 age groups levels (20-39 years = 3.68, 40-49 years = 3.80, 50-59 years = 3.74, and 
60+ years = 3.56). Like gender, participants who chose to not report their age scored the lowest 
in compatibility (3.43). Faculty members in the Science, Technology, Engineering, and 
Mathematics and Social Science, Economics, History, and Political Science departments 
reported the highest mean compatibility scores, followed by faculty members in the Other 
(included Business Administration, English Studies, Industrial Technology, Interdisciplinary 
Studies, and Nursing) group and the Education, Communication, and Game Design departments 
(Science, Technology, Engineering, and Mathematics = 3.87, Social Science, Economics, 
History, and Political Science = 3.68, Education, Communication, and Game Design = 3.41, 
Other = 3.56). 

6 

5 •••••mm 


o 



1 • • • • 


0 

0.00 1.00 2.00 3.00 4.00 5.00 

Compatibility Score 

Figure 1. Scatterplot of compatibility score by level of expertise. Scale 1-5, where 1 = not at all willing, 2 = 
somewhat unwilling, 3 = neither willing nor unwilling, 4 = somewhat willing, and 5 = very willing. 
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Figure 2. Scatterplot of compatibility score by length of use. 0 = less than 1 year or no use of CMS. 

Self-rated level of expertise was also positively associated with compatibility score (r = 
.593, p < 0.01, see Figure 1). In addition, there was a moderate positive correlation between 
length of CMS use in years and compatibility perceptions (r = .546, p < 0.01, see Figure 2). 

Discussion 


Key Findings Summary 

Of the independent variable measurements, only compatibility was significantly 
associated with willingness to complete training (both in-person and online). Consequently, the 
study results suggest that the other independent variables (relative advantage, complexity, 
trialability, and observability) did not significantly influence willingness to complete training on 
the CMS. Bivariate analyses indicated that higher tenure status was associated with lower 
perceptions of compatibility, and, similarly, that faculty perceptions of compatibility increased as 
their ranks decreased. Participants who rated themselves as having higher expertise levels also 
had the highest perceptions of compatibility. Lastly, in most cases, faculty members that used the 
CMS longer had higher perceptions of compatibility with the CMS than those that used the CMS 
for a shorter period of time. 

Faculty members who perceived the CMS as compatible with their teaching styles were 
more willing to complete CMS training. For that reason, a strategy that can be used by 
universities is to identify and work with faculty members who view the CMS as incompatible 
with their teaching styles to help them discover methods to integrate the CMS into their 
classroom activities. This will likely not only increase willingness to engage in CMS training but 
will also promote CMS adoption. 

Results of this study also revealed that faculty members who rated themselves as having a 
high level of expertise in using the CMS preferred online training. On the other hand, faculty 
members with lower expertise levels preferred in-person training. Faculty who reported lower 
expertise levels may benefit from assistance with integrating the CMS into their instruction as 
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well as from technical help. Therefore, universities that design in-person CMS training for 
faculty members with low expertise levels and online training for faculty with higher expertise 
levels will likely increase faculty willingness to complete training on the CMS. 

Connection to the Literature 

In this study, compatibility was found to significantly positively influence faculty 
willingness to complete CMS training, both online and in-person. Although previous researchers 
did not specifically explore how perceptions of compatibility impact faculty willingness to 
complete training, they studied its influence on faculty willingness to adopt instructional 
technology. The findings of this study are generally consistent with the findings of other 
researchers. For instance, Tabata and Johnsrud (2008) found that if faculty members believe that 
distance education is compatible with their working styles then they are likelier to instruct 
distance education classes, and Sayadian et al.’s (2009) results suggested that if faculty members 
perceive that web-based instruction is consistent with their values and teaching methods then 
they are more disposed to integrating web-based instruction in their courses. Also, Tomatzky and 
Klein (1982), who studied general IT adoption, found that compatibility perceptions delivered 
one of the most constant, significant, positive associations within a large variety of innovation 
categories. 

The findings of this research suggest that relative advantage did not significantly 
influence faculty willingness to complete CMS training, either positively or negatively. 
Although other studies did not specifically research how perceptions of relative advantage 
influence faculty willingness to complete training, researchers studied it in relation to faculty 
adoption and use of IT in the classroom. The findings of this study are inconsistent with prior 
research that found either positive or negative relationships. For example, Aremu et al. (2013) 
and Sayadian et al. (2009) found that relative advantage positively impacts faculty IT adoption, 
and Bennett and Bennet’s (2003) research suggested that relative advantage positively influences 
faculty training program effectiveness. Conversely, Tabata and Johnsrud (2008) found an 
association between relative advantage and a decreased use of new technology practices. 
According to Tabata and Johnsrud, this may be because while faculty members perceive that 
distance education affords a relative advantage over current approaches, they do not believe that 
distance education instruction coincides with their responsibilities, needs, or values. Faculty 
members at FSU may have lacked a concept of courses without Blackboard. This is because 
most faculty members have adopted Blackboard for at least basic functions. Since Blackboard is 
widely adopted in at least some way, it may have been difficult for faculty members to gauge the 
“relative” advantage of not using it, given that it is rarely rejected completely at FSU in practice. 
This may explain why the results from this study differ from previous research. 

This study found that perceptions of complexity do not significantly influence instructor 
willingness to complete CMS training. Previous research has not focused on how perceptions of 
the complexity of IT influences willingness to complete training, like this study. Rather, it has 
focused on how it affects faculty member willingness to use IT. The results of this research are 
consistent with studies conducted by Tabata and Johnsrud (2008) and Wang (2009). These 
studies found no significant relationship between faculty adoption of IT and complexity 
perceptions. Yet, these results contradict other study findings which suggested there is a 
significant inverse relationship between faculty IT adoption and complexity perceptions 
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((Bennett & Bennett, 2003; Keesee & Shepard, 2011; Motaghian, Hassanzadeh, & Moghadam, 
2013; Prescott & Conger, 1995). Perhaps complexity has a strong impact only when faculty 
members perceive that the CMS is complex. Faculty members have used the Blackboard CMS at 
FSU for over 10 years, and Blackboard has been upgraded and improved over that time (Green, 
2010). These advances may have lowered FSU faculty perceptions of its complexity to the extent 
that it was not much of an influence. 

The findings of this study suggest that faculty perceptions of trialability do not 
significantly affect willingness to complete CMS training. Although previous studies did not 
focus on how perceptions of trialability influence faculty willingness to complete CMS training, 
they did focus on its influence of faculty willingness to use instructional technology. For 
example, Sayadian et al. (2009) suggested that faculty perceptions of trialability positively 
affects their incorporation of online instruction. Bennett and Bennett (2003) asserted that faculty 
members should be pennitted to try IT in order to foster use, and Tabata and Johnsrud (2008) 
found that pennitting faculty members to try instructional technology increased their adoption of 
it in distance education. It may be that trialability of the Blackboard CMS at FSU is not as 
critical to faculty because it has become much easier to edit courses in Blackboard. This is 
because, over time, Blackboard has become more functional (Blackboard, Inc., 2015). 

This study found that faculty perceptions of observability do not significantly influence 
willingness to complete CMS training. This is in contradiction to previous findings. In particular, 
the results of three studies noted earlier (Bennett & Bennett, 2003; Sayadian et al., 2009; Tabata 
& Johnsrud, 2008) suggested that when faculty members thought their efforts would be 
observable, they would more likely to adopt IT. At FSU, although extensive adoption of all the 
functions of Blackboard is likely not occurring, at least some of its functions are being used in 
the majority of FSU classes. Therefore, the failure to use Blackboard altogether would become 
obvious to colleagues or students. Therefore, since observability is already consistently high, it 
may not influence willingness to complete CMS training. Although it may pressure faculty 
members to increase their Blackboard use, it does not directly result in increased willingness to 
complete training. 

Findings Related to Theoretical Framework 

This study was framed using components of the DOI theory. As conceptualized by 
Rogers (2003), the DOI theory suggests that perceived relative advantage, compatibility, 
trialability, and observability of an innovation positively influences its adoption rate, while 
perceived complexity negatively influences its adoption rate. Of the five attributes, only 
compatibility was related to faculty willingness to complete training on their institution’s CMS, 
and this was a significantly positive relation for both online and in-person training. This 
coincides with Roger’s (2003) theory. 

Though perceptions of relative advantage, complexity, trialability, and observability may 
be influential in general for the adoption of technology as Rogers’ (2003) postulated, there were 
no associations for this study’s dependent variables (willingness of faculty to complete online 
and in-person training on the CMS) and for this technology (CMS). Perceptions of relative 
advantage may not have influenced faculty willingness to complete CMS training because 
Blackboard (in at least some capacity) is already used by most FSU faculty. Therefore, 
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instructors may have had difficulty detennining the “relative” situation of not using Blackboard. 
Regarding complexity, it is probable that FSU faculty did not perceive it to be relatively 
complex, given the high level of complexity of other current technology. Similarly, because 
CMSs, like Blackboard, pennit faculty members to easily modify actions they take in the CMS, 
trialability may not be an important factor in their decisions to complete training. Similarly, in 
this study, observability did not influence willingness to complete CMS training, possibly 
because adoption of the CMS at FSU is already quite observable. 

Study Limitations 

This study is not without limitations. The results of this study are potentially 
generalizable to faculty members who teach at other state universities in the US. They are 
particularly generalizable to campuses that teach undergraduate and graduate students, have a 
faculty base similar to that of FSU, and have a CMS. However, the results may not be 
generalizable to other types of faculties and other settings. In addition, it is possible that the five 
perceived attributes associated with diffusion of innovation theory are not the most optimal 
attributes to explain willingness to complete training on a CMS in this population. Furthermore, 
the instrument used to measure the diffusion of innovation perceptions may not have been ideal. 
Furthermore, the best-subsets modeling approach may not have been the optimal choice for 
modeling, but sensitivity analysis showed that other approaches yielded similar results (Pereira, 
2015), so the results are felt to be robust. Future research should consider other types of faculties 
in other settings, and measure other predictors felt to influence willingness to complete training 
on their CMS. 


Conclusion and Recommendations 

In conclusion, overall, the faculty in this study did not express high levels of willingness 
to complete CMS training, but CMS compatibility with teaching style was an influence. This 
study suggests that training for higher education faculty members on their institution’s CMS 
should not be “one size fits all.” Proper evaluation and categorization of teaching styles, as well 
as current utilization of the CMS are necessary before developing appropriate online and in- 
person training programs. This evaluation will help universities to better administer effective 
training that accommodates faculty members with different philosophies and pedagogical 
approaches to teaching as well as different perceived expertise levels. Further, it will foster 
enhanced and regular use of the institution’s already-implemented CMS. More universal 
adoption by higher education faculty members of their institution’s CMS will undoubtedly lead 
to an overall improvement in the quality of teaching and learning in higher education. 
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